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APPROACHES  FOR  CONVERGENCE  OF  A  BASIC  ITERATIVE 
METHOD  FOR  THE  LINEAR  COMPLEMENTARITY  PROBLEM* 


1.  INTRODUCTION 
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The  linear  complementarity  problem  has  become  a  very  important  subject 
in  mathematical  programming.  Over  the  years,  many  methods  have  been  proposed 
for  the  numerical  solution  of  the  problem.  These  methods  may  be  classified 
as  (i)  direct,  (ii)  iterative  or  (iii)  hybrid.  Direct  methods  are  based  on 
pivoting  techniques  and  have  the  property  of  finite  termination.  Some  of  the 
best-known  direct  methods  are  Lemke's  almost  complementary  pivoting  algorithm 
[27],  Cottle's  principal  pivoting  algorithm  [9]  and  the  parametric  version  of 
Graves'  principal  pivoting  algorithm  [8,  20].  Iterative  methods  generally 
converge  only  in  the  limit.  Hybrid  methods  are  iterative  in  nature  but  use 
some  other  (in  many  cases,  direct)  methods  to  solve  subproblems. 

Both  the  direct  and  iterative  methods  have  their  own  advantages  and 
disadvantages.  Typically,  direct  methods  are  most  suited  for  small  to 
medium  sized  problems.  Their  efficiency  tends  to  decrease  as  the  problem 
size  increases.  This  is  partly  due  to  the  fact  that  both  the  number  of  pivots 
and  the  amount  of  work  required  in  each  pivot  are  expected  to  grow  rapidly 
with  the  problem  size.  Another  disadvantage  of  direct  methods  for  solving 
large  problems  is  the  excessive  amount  of  computer  storage.  On  the  other 
hand,  iterative  methods  usually  require  very  little  extra  storage  because 
they  often  operate  on  the  given  data  only.  As  a  result  of  this  nice  feature, 
iterative  methods  have  become  very  useful  for  solving  many  large  linear 
complementarity  problems  arising  from  applications.  See  [10,  12,  13,  16,  36]. 

Our  purpose  in  this  paper  is  to  continue  our  previous  work  in  [38]  to 
develop  a  general  convergence  theory  of  iterative  methods  for  solving  the 
linear  complementarity  problem.  The  basic  framework  used  throughout  the 
analysis  is  built  on  the  rather  old  concept  of  matrix  splittings  [41]. 


Specifically,  given  a  splitting  of  the  matrix  defining  the  linear  com¬ 
plementarity  problem,  a  basic  algorithm  (in  the  sense  of  Zangwill  [43])  is 
constructed  which  generates  a  sequence  of  iterates  by  solving  seme  linear 
complementarity  subproblems.  Depending  on  the  properties  of  the  splitting 
involved,  four  different  approaches  may  be  used  to  establish  the  convergence 
(to  a  desired  solution  of  the  given  linear  complementarity  problem)  of  the 
sequence  generated.  In  what  follows,  we  give  an  overview  of  these  approaches. 

The  first  approach,  to  be  called  the  symmetry  approach  is  based  on  the 
assumption  that  a  certain  quadratic  function  can  be  used  to  monitor  the 
progress  of  the  algorithm.  Typically,  this  approach  is  used  in  the  case  when 
the  matrix  defining  the  original  linear  complementarity  problem  possesses 
some  symmetry  property  (although  the  matrix  itself  need  not  be  symmetric) . 

For  instance,  if  the  given  complementarity  problem  arises  as  the  set  of 
Karush-Kuhn-Tucker  optimality  conditions  of  a  convex  quadratic  program,  then 
the  objective  function  of  the  program  is  a  natural  candidate  to  be  used  in 
the  monitoring  process.  Some  references  on  this  approach  are  [5,  10,  11,  12, 
13,  16,  30]. 

The  second  and  third  approaches  were  initially  used  by  Ahn  [3]  in  his 
doctoral  dissertation  to  establish  the  convergence  of  the  PIES  algorithm  [21]. 
Both  approaches  are  based  on  some  standard  contraction  argument.  One  of 
them  involves  "norm-contraction"  and  the  other  "vector- contract ion".  (More 
detailed  explanation  of  these  two  terms  will  be  given  later.)  In  the  earlier 
paper  [38],  the  author  has  extended  Ahn's  work  [4]  and  has  established  a 
rather  general  convergence  result  (based  on  the  vector-contraction  approach) 
for  the  basic  algorithm  mentioned  previously.  Later  in  the  paper,  this  result 
will  be  improved.  Incidentally,  the  norm-contraction  approach  has  also  been 
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used  by  Aganagic  [1]  in  his  convergence  proof  of  a  particular  iterative 
method  for  solving  the  linear  complementarity  problem  with  an  asymmetric 
matrix. 

Finally,  the  fourth  approach,  to  be  called  the  monotone  approach, 
involves  showing  that  the  sequence  of  iterates  is  both  nonincreasing  and 
bounded  below  (in  the  vector  sense).  Once  these  two  properties  are  estab¬ 
lished,  the  desired  convergence  of  the  iterates  is  obtained  easily. 

Typically,  the  monotonicity  of  the  iterates  is  implied  by  some  least-element 
connection  of  the  linear  complementarity  subproblems.  See  [37]. 

Once  the  convergence  of  the  iterates  is  established,  an  equally  important 
question  is  how  fast  the  convergence  is,  in  other  words,  what  the  convergence 
rate  of  the  algorithm  is.  Typically,  this  rate  may  not  be  easy  to  obtain  if 
the  symmetry  or  monotone  approach  is  used.  The  two  contraction  approaches 
usually  give  rise  to  a  geofaetrical  rate  of  convergence.  In  this  paper,  we 
shall  be  concerned  merely  with  the  convergence  of  the  basic  algorithm  and 
shall  not  address  its  rate  of  convergence. 

The  organization  of  the  rest  of  this  paper  is  as  follows.  In  the  next 
section,  we  formally  introduce  the  basic  algorithm  and  show  how  it  includes  a 
block  relaxation  method  for  a  certain  strictly  convex  quadratic  program  as  a 
special  case.  In  the  four  sections  following  Section  2,  we  investigate  the 
convergence  of  the  basic  algorithm  using  the  four  approaches  outlined  above. 
Finally  in  the  last  section,  we  draw  some  concluding  remarks  concerning  the 
possibility  of  extending  our  analysis  given  here  to  treat  other  complementarity 
and  variational  problems. 


m 


2.  THE  BASIC  ALGORITHM 


Given  an  n-vector  q  and  n  by  n  matrix  M,  the  linear  complementarity 
problem  (q,  M)  is  to  find  an  n-vector  x  so  that  the  conditions  below  are 
satis fied 

T 

u  »  q  +  Mx  >  0  ,  x  >  0  and  u  x  *  0  . 

By  a  splitting  of  the  matrix  M,  we  mean  the  representation 

M  -  B  +  C 

where  B  and  C  are  matrices  of  the  same  order  as  M.  We  denote  such  a  splitting 
by  (B,  C) .  In  [38],  we  have  introduced  the  following  algorithm  as  a  unifying 
framework  for  the  study  of  many  iterative  methods  for  solving  the  linear 
complementarity  problem  (q,  M) . 

Basic  Algorithm.  Let  (B,  C)  be  a  splitting  of  the  matrix  M  and  let  E  be  an 

n  by  n  nonnegative  diagonal  matrix  with  E  ^  <  1  for  all  i.  Let  x°  be  an 

arbitrary  initial  vector.  Generate  the  sequence  of  vectors  {x^}  as  follows, 
k  k+1 

Given  x  ,  let  x  be  a  solution  to  the  complementarity  problem 

u  ■  q  +  Cx^  +  Bx  >  0  ,  x  >  Ex^  and  uT(x  -  Exk)  *  0  .  (1) 

Alternatively,  the  algorithm  may  be  described  in  terms  of  the  associated 

algorithmic  map  G  where  for  each  given  vector  y  6  Rn  ,  G(y)  is  the  set  of  all 

solutions  to  the  complementarity  problem  (1)  with  y  replacing  x  .  Using  the 

k+1  k 

map  G,  we  may  rephrase  the  algorithm  as  :  x  €  G(x  ).  It  is  easy  to  show 
that  any  fixed  point  of  G  ,  i.e.,  any  vector  y  such  that  y  €  G(y),  is  a 
solution  to  the  linear  complementarity  problem  (q,  M) . 

The  problem  (1)  is  not  in  the  exact  form  of  a  standard  linear  complemen¬ 
tarity  problem  (q,  M).  However,  by  means  of  the  simple  translation  of 


It 

variables  z  ■  x  -  Ex  ,  (1)  is  obviously  equivalent  to  the  linear  complemen¬ 
tarity  problem  (q\  B)  where  qk  -  q  +  (C  +  BE)xk  . 

So  far,  we  have  not  stated  any  condition  on  the  splitting  (B,  C)  to 
guarantee  that  each  linear  complementarity  subproblem  (1)  is  solvable.  From 

now  on,  we  simply  declare  this  as  a  blanket  assumption  of  the  paper  and  will 

k+1 

not  be  concerned  with  the  exact  manner  in  which  x  is  computed.  The  analysis 
in  the  subsequent  sessions  will  be  devoted  entirely  on  investigating  the 
convergence  of  the  sequence  £x^}  generated.  (For  practical  purposes,  the 
splitting  (B,  C)  should  be  such  that  each  linear  complementarity  subproblem 
(1)  can  be  solved  fairly  easily.) 

By  appropriately  choosing  the  splitting  (B,  C)  and  the  diagonal  matrix 
E,  we  [38]  have  known  how  Mangasarian* s  iterative  scheme  [30]  and  the  point 
successive  overrelaxation  (SOR)  method  of  Cottle,  Golub  and  Sacher  [17]  can  be 
cast  as  special  cases  of  the  basic  algorithm  described  above.  Zn  what  follows, 
we  demonstrate  that  the  relaxation  method  of  Cea  and  Glowinski  [5]  specialized 
to  solve  strictly  convex  quadratic  programs  with  separable  constraints  is 
also  a  special  realization  of  our  basic  algorithm.  Specifically,  consider 
the  quadratic  program 

T  T 

minimize  £  v*Qv  +  f  v  subject  to  F^v^  <  e^  ,  v^  >  0  ,  i  *  1,...,K  (QP) 

where  the  matrix  Q  is  symmetric  positive  definite  and  the  vector  v  is 

partitioned  into  K  subvectors  v^  (i  ■  1,...,K).  Let  the  matrix  Q  *  (Q^) 

and  vector  f  ■  (f^)  be  partitioned  accordingly.  Then  the  relaxation  method 

of  Cea  and  Glowinski  works  as  follows.  Let  <  2  be  positive  scalars, 
k  k  k+1  k+1 

Given  v  *  (v^)  ,  compute  v  ■  (v^  )  by  successively  solving  the  quadratic 


subprogram 
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minimize  i  -  [Qi±vJ  -  «l(j  =  ±  Q^v^1  +  ^i  QtJvJ  +  f£)  ]Tvt  (QP^ 

subject  to  F/v^  <  e^^  and  vi  >  0 
k+1 

and  letting  v be  its  unique  solution.  The  u>^  are  the  relaxation  parameters. 

To  simplify  the  notations,  let’s  fix  K  =  3.  The  Karush-Kuhn-Tucker 


conditions  for  the  program  (QP)  and  the  subprogram  (QP^)  can  be  formulated 
respectively,  as  the  linear  complementarity  problems  (q,  M)  and  (q^,  N^)  where 


T 

f;  q. 


0  -F„ 


P2  q23 


£t +  £V]  *  £Vl  '  (l  -  Ui>^iivi^0)i  \  ’  »ti 


Q,.Au.  F. 
ii  l  i 


k+1 

By  letting  Xt  be  an  optimal  Lagrange  multiplier  of  the  subprogram  (QP^ , 


it  is  easy  to  see  that  the  vector  x 


k+1  ,  k+l 


k  )  solves  the  linear 


complementarity  problem  (1)  with  E  ■  0  » 


/QU/”l 


Q22/»2 


and  C 


"lQU 


0  Q, 


0  au.Q,,, 

2*22 


0  J3Q33 
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and  where  5^  »  -(l-mp/cs  .  Note  that  (B,  C)  is  in  fact  a  splitting  of 
the  matrix  M  given  in  (2) .  Consequently,  we  have  shown  that  with  this 
particular  splitting,  our  basic  algorithm  reduces  precisely  to  the  relax¬ 
ation  method  of  Cea  and  Glowinski.  A  noteworthy  point  here  is  that  the 
above  matrix  B  is  generally  not  such  that  all  linear  complementarity  prob¬ 
lems  (r,  B)  are  solvable.  However,  due  to  the  special  structure  of  B, 
each  subproblem  (1)  will  have  a  solution  if  the  original  quadratic  program 
(QP)  is  feasible. 

Basically,  the  above  relaxation  method  of  Cea  and  Glowinski  is  just  one 
member  of  the  family  of  block  SOR  methods  for  solving  convex  quadratic 
programs.  Another  version  of  such  methods  was  first  proposed  in  [12]  and 
recently  refined  in  [13].  We  have  not  been  able  to  show  whether  this  latter 
version  can  also  be  cast  in  the  form  of  the  basic  algorithm,  except  in  the 
case  when  the  relaxation  parameter  does  not  exceed  one.  See  [38].  This 
is  partly  due  to  the  fact  that  the  relaxation  step  is  performed  in  a  slightly 
different  way  from  the  one  in  the  method  of  Cea  and  Glowinski.  For  more 
discussion  on  the  relationship  between  these  two  block  SOR  methods,  see  [11], 

We  should  say  a  few  more  words  about  the  basic  algorithm  before  ending 
this  section.  Matrix  splittings  are  extremely  useful  in  the  study  of 
iterative  methods  for  solving  systems  of  linear  equations  [31,  41],  The 
construction  of  the  basic  algorithm  is  partly  based  on  the  belief  that  the 
matrix  splittings  should  be  equally  useful  in  the  case  of  the  linear  com¬ 
plementarity  problem.  Furthermore,  because  of  its  generality,  one  could 
choose  (provided  that  one  knows  how)  the  splitting  that  is  most  appropriate 
for  the  individual  problems.  Hopefully,  the  various  results  established 
in  subsequent  sections  would  then  allow  one  to  draw  some  affirmative  con¬ 
clusion  about  the  convergence  of  the  algorithm. 
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3.  THE  SYMMETRY  APPROACH  FOR  CONVERGENCE 

Starting  in  this  section,  we  shall  derive  some  convergence  results  for 

the  basic  algorithm  presented  in  the  last  section.  As  mentioned  in  the 

introduction,  we  shall  follow  four  different  approaches.  In  this  section, 

we  give  result  based  on  the  symmetry  approach.  The  following  is  the  main 

convergence  theorem  of  this  approach.  Recall  that  a  copositive  matrix  M  is 
T 

one  such  that  x  Mx  >  0  for  all  x  >  0  and  a  copositive-plus  matrix  is  a 

T 

copositive  matrix  M  which  satisfies  the  implication:  [x  Mx  =  0  ,  x  >  0]  =» 
(M  +  MT)x  =  0  . 

Theorem  1.  Let  E  be  a  nonnegative  diagonal  matrix  with  E^  <  1  and  let 
(B,  C)  be  a  splitting  of  M  satisfying 

(3.1)  B  *  U  +  V  +  CT  ; 


(3.2)  There  exists  a  permutation  matrix  P  and  a  nonempty  index  set  a  (with 
complement  8)  such  that 


T 

P  VP  =■ 

1  0  1 

T 

,  P  CP  » 

o 

o 

T 

PEP  = 

(  0  i 

/  o  U  J 

|  aa  1 

[  aa 

aae 

and  PTUP  =  ^ 

o 

o 

t 

o 

o 

» 

o 

o 

T 

°  , 

where  V  ....  is  symmetric  positive  definite; 
c*or 

(3.3)  Each  of  the  linear  complementarity  subproblems  (1)  is  solvable. 
Suppose  also  that  the  initial  vector  x°  is  nonnegative  and  satisfies 

xa  ■  0  • 

Then  every  accumulation  point  of  the  sequence  [x^}  generated  by  the  basic 
algorithm  solves  the  linear  complementarity  problem  (q,  M) .  Moreover,  if 
in  addition,  the  condition  below  is  satisfied 

T 

(3.4)  The  matrix  ■  (V  +  C  +  C  )  is  copositive-plus  and  there  exist 

1  2 

vectors  ya  and  yff  so  that 
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qa  +  Aaa  yi  >  0  (4i> 

and 

yl>0  and  q0  -  U^y*  >  0  .  (4ii) 

Then  the  sequence  fx^}  is  bounded  and  therefore  has  an  accumulation  point 
which  solves  the  linear  complementarity  problem  (q,  M) . 

We  point  out  several  remarks  about  the  above  theorem.  First  of  all,  in 
order  to  satisfy  all  the  conditions  (3.1)-(3.4),  the  matrix  M  need  not  be 
symmetric  or  positive  semi -definite,  although  it  must  be  copositive-plus  (if 
(3.4)  holds).  In  fact,  the  matrix  M  after  a  principal  rearrangement  is  given 
by 


(5) 


which  is  bisymmetric.  Second,  the  matrix  V  must  be  symmetric  positive  semi- 


definite  by  condition  (3.2),  whereas  B  needs  not  be  so.  Third,  it  is  easy  to 
see  that  the  matrix  M  in  (2)  with  the  splitting  (B,  C)  defined  in  (3) 
satisfies  conditions  (3.1)  and  (3.2)  of  the  theorem.  In  fact,  it  suffices 
to  choose 


The  requirement  that  each  relaxation  parameter  6  (0,  2)  is  needed  in  order 


for  the  submatrix 
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to  be  positive  definite.  As  noted  in  the  last  section,  condition  (3.3)  holds 
if  the  quadratic  program  (QP)  is  feasible.  As  for  condition  (3.4),  the  matrix 
Aaa  -  Q  is  positive  definite  (and  thus  copositive-plus)  by  assumption.  The 
system  (4i)  is  consistent  for  the  same  reason.  The  consistency  of  the  system 
(4ii)  is  implied  by  the  existence  of  a  Slater  point  in  the  program  (QP) . 

In  essence,  this  last  condition  (consistency  of  (4ii))  is  not  required  in 
the  proof  of  convergence  of  the  sequence  of  primal  vectors  v  in  the  relax¬ 
ation  method  of  Cea  and  Glowinski.  It  is  needed  in  order  for  the  sequence 
of  optimal  multipliers  to  converge  as  well. 

The  main  convergence  results  obtained  by  Mangasarian  [30]  for  his 
iterative  scheme  are  special  cases  of  Theorem  1.  In  fact,  as  pointed  out  in 
[38],  Mangasarian' s  scheme  is  a  special  case  of  our  basic  algorithm  with 
E  =  (l-X)I  and  the  splitting  (B,  C)  given  by 

B  =  (X.UJ*)  *D  +  K  and  C  =  (M  -  K)  -  (Xur*)’1^ 

where  D  is  a  positive  diagonal  matrix,  K  is  a  strictly  triangular  matrix, 

0  <  X  <  1  and  u*  >  0.  (In  the  original  statement  of  the  algorithm, 

Mangasarian  allows  the  matrices  D  and  K  to  vary  from  one  iteration  to  the 
next.  In  essence,  we  could  do  the  same  thing  in  our  basic  algorithm.  That 
is,  we  could  let  the  splitting  (B,  C)  depend  on  the  iteration.  However  for 
the  sake  of  simplicity,  we  choose  not  to  include  this  generality  in  the 
treatment.)  In  stating  his  algorithm,  Mangasarian  requires  that  there 
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exists  a  Y  >  0  such  that 

yT[(Xcu*)  lD  +  K  -  ^]y  >  v[fy!|2  for  all  y  . 

obviously,  this  last  condition  is  equivalent  to  the  positive  definiteness 
of  the  matrix 

V  =  2(Xtu*)-1D  +  KT  +  K  -  MT  . 

If  M  is  symmetric  (this  is  a  crucial  assumption  in  Mangasarian' s  proofs), 
then  so  is  V.  It  is  now  easy  to  see  that  conditions  (3.1)  ~  (3.3)  are 
satisfied  (a  is  the  entire  index  set  [l,...,n]  and  P  is  the  identity  matrix). 
Condition  (3.4)  reduces  to  the  one  in  Theorem  2  of  [30], 


L 


Proof  of  Theorem  1.  First  note  that  by  the  choice  of  x°,  the  sequence  {x^} 
is  nonnegative  and  satisfies 

’  Uagx*  =  °  f°r  211  k  ^  °  • 

We  shall  let  the  quadratic  function 

f(x)  =  q£xa  +  &xT  MX 

monitor  the  progress  of  the  algorithm.  By  the  structure  (5)  of  M,  it  follows 
that 

+  **1  Ac**x«  • 

We  now  show  that  the  sequence  {f(x^)}  is  nonincreasing.  In  fact,  we  have 


k+1  k.  .  ,  .  k.T.  k+1  k.  ±  k+1  k.T  .  .  k+1  k 

f(x  )  -f(x  )  =  (q^  +  A^)  (x  -x  )a  +  t(x  -x%  Aaa(x  -x  )a 

.  .  „  k,  .  T.  k+l.T.  k+1  k.  i.  k+1  k.T  „  .  k+1  k. 

3  <^  +  c«Ar+<v  +  c  >  <x  -xV*(x  -X>«V««<X  -x>a 

/  k+1  k+l.T.  k+1  k.  .  k+l.T.,1  k+1  „T  k. 

=  H*  +  Cc*axcy  +  (V  +  C  >«**«  +lVs  >  (x  ‘ x  V  (x3  >  (Uo8xo  ‘  Ua6  V 

i.  k+1  IcT  .  k+1  k. 

-  t(x  -x>aVa(y(x  -  x  )„ 
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/  ,  „  It  ,  j-Tv  k+1  ,  „  k+l.Tr.  k+1  „  k.  ,  /r,  k. 

+  Caaxa  +  (v  +  c  ) aaxa  +Ua0x0  )[(x  -  Ex  )  +  (E  -  I)x  Ja 

.  k+LTr/  „T  k+1.  .  T  k.  .  i.  k+1  k.T  „  .  k+1  k. 

+  <*8  )  [(q9’Va  )-%-UaBV1^(x  'x>*Wx  ‘x>« 


,  i.  k+1  k.T  .  k+1  k.  n 
<  -  £(*  -x  >«  Wx  -x  )a<  0  , 


k+1 


where  Che  next  to  last  inequality  follows  from  the  fact  that  x  solves  the 
linear  complementarity  problem  (1)  and  from  the  observation  made  at  the  start 
of  the  proof  concerning  the  sequence  fx^}. 

k  k 

Now  let  x*  be  an  accumulation  point  of  the  sequence  fx  }  and  let  [x 

k 

be  a  subsequence  converging  to  x*.  As  noted  in  f30 ] ,  the  sequence  [f(x  )] 
must  then  converge.  It  therefore  follows  that 

k  -1 


i  < 

lim  x  J  =  lim  x  J 

t-  “  j-  * 


(6) 


For  each  k^,  we  have 


k. 

V 


u-j  =  % 


+  Bq  X 


0Qf  Of 


and 


k.  k  ^.-1  T 

(u  (x  ^  -  E_x  ^  )  =  (ua J)  xQJ 

K  a  ’  v  or  o ta  a  '  v  B  '  0 


>0  xaJ  >  0 

=■  D  - 


0  . 


(7i) 

(7ii) 

(7iii) 


By  passing  the  limit  -*  •  and  using  (6),  we  conclude  immediately  that  x* 
solves  the  linear  complementarity  problem  (q,  M) . 

Suppose  now  that  the  condition  (3.4)  also  holds.  It  suffices  to  show 
that  the  sequence  {x^}  is  bounded.  We  first  show  that  {x^}  is.  Suppose  not. 
Then  by  Lemma  3  in  [30],  we  may  deduce  that  there  exists  a  vector  z*  satisfying 


0  *  z*  >  0  ,  q£z*  <0  and  <z*)T  A^z*  -  0  . 

By  the  assumed  property  of  A^,  we  obtain  A^z*  *  0  .  But  this  would  contradict 
the  consistency  of  the  system  (4i) .  Hence  {x^}  must  be  bounded.  Finally,  we 


show  that 


k  Ki 

£x^}  is  bounded.  Suppose  not;  then  there  is  a  subsequence  {x^} 

such  that  -•  ®  .  The  normalized  subsequence  [xg J/]|xgJ!f }  has  an 

accumulation  point  z*  .  With  no  loss  of  generality,  we  may  assume  that 

h,  k,  k . 

z  J/,  zQJ  ■*  z*  .  Since  the  sequence  x  3  is  bounded,  it  has  an  accumulation 
p  P  P  or 

point  z*  .  By  considering  a  suitable  subsequence  if  necessary,  we  may 

k.  k 

assume  that  xa-3  **  z*  .  Dividing  (7i)  by  JJ z  j [[  and  passing  the  limit  k.  -»  •  , 

b  J 

we  obtain 


B 


0(6 


ZB  ^  ° 


Moreover,  we  have  from  (7iii) 


(8) 


f'1  -  y-Jl  “os*!  - ° 

which  implies  by  the  fact  that  I-E^,  is  a  positive  diagonal  matrix 

QrQr 

<2J)t  b«  2I  - 0  • 


Similarly,  we  obtain  from  (7ii)  and  (7 Hi) 


(z*)T  [qg  +  BBaz*]  -  0  . 

Since  ®  ■  -  Bga  ,  it  follows  that  (z*)Tqg  »  0  .  This  together  with 

(8)  and  the  fact  that  z|  ^  0  ,  would  contradict  the  consistency  of  the  system 
(4ii).  The  contradiction  completes  the  proof  of  the  theorem. 


i 
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4.  THE  NORM-CONTRACTION  APPROACH  FOR  CONVERGENCE 

An  implication  of  the  assumptions  of  Theorem  1  is  that  the  matrix  M 
must  be  bisymmetric  with  a  zero  diagonal  block.  In  this  and  the  next  two 
sections,  we  derive  some  convergence  results  by  replacing  the  symmetry 
requirement  with  some  other  assumptions.  We  first  review  some  matrix  con¬ 
cepts  [31]. 

If  A  is  a  symmetric  positive  definite  matrix,  then  it  has  a  unique 

i  1  T  i 

Cholesky  factorization  A  =  (Aa)  (Aa)  where  Aa  denotes  the  Cholesky  factor 
(or  square  root)  of  A.  The  ip-norm  (1  <  p  <  ®)  of  the  matrix  A  is  defined 
by 

J|aJ[  =  max  [|Ax|| 

"p  i|xj;  .i  "p 

•'  "p 

where  !fx[[  =>  (  E  | x .  | **) 1  is  the  ip-norm  of  an  n-vector  x.  (Note: 

P  i’1  ^ 

jlxjl  =  max  |x.[  .)  The  Holder  inequality  [31]  states  that 
®  l<i<n  1 

|xTy]  <  !,!xl|p  l|yj|q  where  J  J  -  1 

with  equality  holding  if  and  only  if  x  is  a  scalar  multiple  of  y.  We  denote 
by  p(A)  the  spectral  radius  of  the  matrix  A.  It  is  known  that  p(A)  <  ||A{} 
for  all  p  €[1,  <*>]. 


Theorem  2.  Let  (B,  C)  be  a  splitting  of  the  n  by  n  matrix  M  such  that 

(4.1)  B  *  U  +  V  where  U  is  skew-symmetric; 

(4.2)  There  exists  a  permutation  matrix  P  and  a  nonempty  index  set  <*  (with 
complement  0)  such  that 


V _  0  \  , 

PTCP  -  c 

0  \ 

aa  * 

aa 

0  Vftf  1 

.  0 

0  1 

with  V _  being  synmetric  positive  definite  and  Vaa  symmetric  positive  semi- 

aa  pp 

definite; 

(4.3)  Each  of  the  linear  complementarity  subproblems  (1)  with  E  ■  0  has  a 
solution; 

(4.4)  "v-i  (V^)T  '|p  <  i  for  some  p  €[1,  «]  . 

Then  any  accumulation  point  of  the  sequence  {x^}  generated  by  the  basic 
algorithm  with  E  ■  0  is  a  solution  to  the  linear  complementarity  problem 
(q,  M) .  Moreover,  if  in  addition,  the  condition  below  is  satisfied 

2 

(4.5)  There  exists  a  vector  ya  such  that 

yl>°  and  «B  -  uoe4  >  °* 

k 

then  the  sequence  [x  }  is  bounded  and  therefore  has  an  accumulation  point 
which  solves  the  problem  (q,  M) . 

Before  proving  the  theorem,  we  discuss  some  implications  of  its  assump¬ 
tions.  First  of  all,  the  matrix  M,  after  a  principal  rearrangement,  is  of 
the  form 


which  is  similar  to  (5).  However,  the  properties  of  the  two  diagonal  blocks 
in  the  two  forms  are  quite  different.  In  (5),  the  two  diagonal  blocks  are 
symmetric  (in  fact,  one  of  them  is  zero).  They  are  not  in  (9).  On  the  other 
hand,  it  can  be  shown  easily  that  if  p  ■  2  in  condition  (4.4),  the  matrix 
V„,  +  and  thus  +  U  is  positive  definite  (see  [3]  e.g.,) 

QrQr  aOt  Orar  OtGt  Orar  Or or 


The  corresponding  diagonal  block  in  (5)  may  not  even  be  semi-definite.  The 
whole  matrix  in  (9)  is  positive  semi-definite.  Summarizing,  we  could  say 


6- 


that  in  Che  present  case,  we  are  trading  symmetry  of  the  splitting  (B,  C) 
with  a  stronger  form  of  positive  definiteness  (condition  (4.4)). 

In  [3],  Ahn  noted  that  the  PIES  algorithm  can  be  applied  to  a  linear 
complementarity  problem  with  a  bisymmetric  matrix.  In  general,  such  a 
linear  complementarity  problem  is  of  the  form 


The  PIES  algorithm  operates  by  solving  a  sequence  of  linear  complementarity 
problems 


'•lj  ■ 

f"l)  *  1 

((M-M)Xj  1 

|  + 

!S*T)K)*0-  ,v 

w 

IV  1 

k(N-N)x^  j 

'V-A  N  /  1  x2  /  i  x2  ( 

.  „  T  _  T 
>  0  ,  w^x^  W2*2 


where  M  and  N  are  the  diagonal  parts  (assumed  positive)  of  M  and  N  respectively. 
Note  that  each  such  subproblem  is  a  strictly  convex  quadratic  program.  It  is 
easy  to  see  that  the  PIES  algorithm  is  a  special  case  of  our  basic  algorithm 
with  E  ■  0  , 


B  - 

|  M 

Al! 

and 

C  -  j M-M  0 

l -A 

»/ 

1  0  N-N 

Obviously  with  Of  chosen  as  the  entire  index  set,  P  the  identity  matrix 


U  - 

f  o  AT1 

and  V  ■  J 

f  M  o' 

o 

< 

1 

\  0  N 

conditions  (4.1)  and  (4.2)  are  satisfied.  Condition  (4.3)  holds  because  the 
matrix  B  is  positive  definite.  Finally,  with  p  ■  2,  (4.4)  is  precisely  the 
norm  condition  derived  for  the  convergence  of  the  PIES  algorithm  [3]. 
(Condition  (4.3)  is  void  in  this  instance  because  9  is  empty.) 
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The  matrix  in  (9)  is  also  bisymmetric.  This  does  not  imply,  however, 
the  PIES  algorithm  applied  to  the  linear  complementarity  problem  (q,  M) 
where  M  is  the  matrix  in  (9)  will  converge.  One  reason  is  that  the  norm 
assumption  required  in  the  convergence  proof  of  the  PIES  algorithm  would 
imply  that  M  should  be  positive  definite.  In  general,  M  is  only  semi- 
definite. 

Another  special  case  of  Theorem  2  is  Aganagic's  convergence  result  for 
his  iterative  scheme  [1].  As  noted  in  [38],  Aganagic's  scheme  corresponds 
to  our  basic  algorithm  with  E  ■  0  , 

B  *  -~tI  and  C  -  M  -  -—I 

ru*  tu* 

where  is  a  positive  parameter.  Specialized  to  this  splitting,  condition 
(4.4)  becomes  '' I  -  <  1  which  is  precisely  the  one  required  by  Aganagic. 

As  a  final  remark  on  the  conditions  of  Theorem  2,  we  point  out  that 
since  the  matrix  B  is  positive  semi-definite,  condition  (4.3)  is  equivalent 
to  the  feasibility  of  each  of  the  subproblems  (1)  [7]. 


Proof  of  Theorem  2.  For  k  >  1,  we  have 

k  k- 1  ,  _  k  -  k  ,  k,T  k  _ 

u  ■  q  +  Cx  +  Bx  >0  ,  x  >0  ,  (u)x  *  0 

k+1  ,  _  k  ,  _  k+1  k+1 ^  n  ,  k+i.  T  k+i  n 

u  "q  +  Cx+Bx  >0  ,  x  >0  ,  (u  )x  *0. 

Hence  it  follows  that 

k+1  k.T,  k+1  k.  ,  k+i  k.  T  r_ .  k+1  fc  .  k  k-1.  , 

0  >  (x  -  x  )  (u  -  u  )  -  (x  -  x  )  [B(x  -  x  )  +  C(x  -  x  )] 

By  (4.1)  and  (4.2),  we  obtain 

.  k+1  k.T  „  ,  k+1  k.  ^  .  k+1  k.T„,  k+1  k.  ^  ,  k+1  k.T„  ,  k  k-L 

(x  *x)aV«a(x  'x)«S(x  -O  V(x  -x)<-(x  -*)aCaa(x-x  )£ 

Hence  by  Holder's  inequality,  it  follows  that 


where  Y  *  JV^  ||  .  Since  Y  <  1  ,  a  standard  contraction  argument 

gives  immediately 

lim(xk+1  -  x*S  -  0  , 
k-*> 

Moreover,  the  sequence  {xk}  is  bounded  for  the  same  reason.  The  rest  of  the 
proof  resembles  that  of  Theorem  1  and  is  not  repeated  here. 

Remark.  It  is  easy  to  see  from  the  above  proof  that  Theorem  2  remains  valid 
if  condition  (4.4)  is  replaced  by  the  following  one: 

kj2<* 

where  \  is  the  least  eigenvalue  of  the  matrix  V  .  In  fact,  one  can  even 
drop  the  symmetry  assumption  on  if  (4.4)'  holds  with 
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5.  THE  VECTOR- CONTRACT ION  APPROACH  FOR  CONVERGENCE 


In  this  section,  we  establish  a  convergence  result  of  the  basic  algo¬ 
rithm  by  using  a  vector-contraction  arguement.  To  start,  we  review  some 
more  matrix  concepts. 

Let  M  be  a  real  square  matrix.  Its  comparison  matrix  M  =  (M.j)  is 
defined  by 


”ij  *  r  JMit I  for  1  "  J 

| “ lMi j i  for  i  *  1  ■ 

Obviously,  M  is  a  Z -matrix,  i.e.,  it  has  nonpositive  off-diagonal  entries. 

If  M  is  a  P-matrlx  as  well,  i.e.,  if  M  has  all  principal  minors  positive, 
then  M  is  said  to  be  an  H-matr lx  [42].  It  has  been  proved  in  [34]  that  H- 
matrices  with  positive  diagonal  entries  are  themselves  P-matrices.  In 
particular,  if  M  is  an  H-matrix  with  positive  diagonals,  then  the  linear 
complementarity  problem  (q,  M)  has  a  unique  solution  for  all  vectors  q  [39]. 

It  is  obvious  that  principal  submatrices  of  H-matrices  are  themselves  H-matrices. 

A  Z-matrix  which  is  also  a  P-raatrix  is  known  as  a  K-matrix  [19].  An 
equivalent  way  to  define  an  H-matrtx  is  to  say  that  its  comparison  matrix  is 
a  K-matrix.  If  M  is  a  K-matrix,  then  M  *  exists  and  is  nonnegative.  If 
M  and  N  are  both  Z-matrices  such  that  M  <  N  and  M  is  a  K-matrix,  then  so 
is  N  and  M  >  N  See  [19]  for  more  details  on  these  and  other  properties 
of  K-mat rices. 

If  M  and  N  are  two  nonnegative  matrices,  then  p(M)  <  P(N).  If  M  is 
any  matrix,  by  | M J  we  denote  the  matrix  whose  entries  are  the  absolute 
values  of  those  of  M.  Similarly,  if  x  is  a  vector,  by  ( x J  we  denote  the 
vector  whose  components  are  the  absolute  values  of  the  ones  in  x. 


The  following  convergence  result  was  proved  in  [38]. 


Theorem  3.  Let  E  be  a  nonnegative  diagonal  matrix  with  <  1  for  all  i. 

Let  (B,  C)  be  a  splitting  of  the  matrix  M  such  that 

(5.1)  B  is  an  H-matrix  with  positive  diagonal  entries; 

(5.2)  P(B  max(DE,  jcj))  <  1  where  B  is  the  comparison  matrix  of  B  and  D 
is  the  diagonal  part  of  B. 

Then  each  of  the  linear  complementarity  subproblems  (1)  has  a  unique  solution. 
Moreover,  the  sequence  [x^3  generated  converges  to  the  unique  solution  of 
the  linear  complementarity  problem  (q,  M) . 

The  theorem  below  shows  that  condition  (5.2)  can  be  replaced  by  a  weaker 

one. 


Theorem  3 1 .  Theorem  3  remains  valid  if  condition  (5.2)  is  weakened  to 

(5.2)'  There  exists  a  matrix  G  with  p(G)  <  1  such  that  for  any  index  set  a 
(with  complement  0) 


G  > 

M 

O 

< 

1  E«« 

0 

(®0ar  ®00  /  ! 

|  ^C3a' 

(10) 


Before  proving  Theorem  3',  we  show  that  if  condition  (5.1)  holds,  then 

(5.2)  implies  (5.2) 'but  not  conversely.  In  fact,  we  claim  that  (10)  holds 
with  G  *  B  *  max(DE,  [c[).  To  prove  this,  note  that  the  product  matrix  in 
(10)  is  equal  to 


acr 


1  Kl  <-w«  +  !<W>  Kl  !W/  • 


0 

-1  !, 


(11) 


1 


-21- 


B  < 

fo*.  0  ' 

and  max(DE  ,  |c|)  > 

0 

1  “sor  *33 

\  lce«l 

1C89' , 

we  obCaln 


*"1  _  1  < 

-1 

B  max(DE  ,  |C|)  > 

QfQf 

0 

DofQ'  Eaa 

0 

'~"w» 

CD 

Q 

B88  1 

\WJ 

f  c30 !  / 

f 


It  is  easy  to  see  that  the  matrix  in  the  right  side  of  the  above  inequality 
is  precisely  the  one  given  in  (11).  This  establishes  our  claim  that  (10) 
holds  with  G  ■  B  *  max(DE  ,  |c|).  To  show  that  condition  (5.2)'  does  not 
necessarily  imply  (5.2),  consider  the  data 


B  ■  I 

f  1  -il 

c/i  o' 

and  E  = 

fi  o’ 

1 

1 J 

•  °  a 

i°  i  i 

It  Is  easy  to  see  that  condition  (5.2)'  holds  with 


On  the  other  hand,  we  have 


B_l  max (DE  ,  |c|) 


* 


and  p(B  *  max(DE  ,  J  C | ) )  =  1  . 

It  has  been  proved  in  [38]  that  the  assumptions  of  Theorem  3  imply  that 
the  original  matrix  M  must  be  an  H-matrix  with  positive  diagonals.  (This 
is  why  the  linear  complementarity  problem  (q,  M)  has  a  unique  solution.)  In 
what  follows,  we  show  that  the  same  conclusion  about  the  matrix  M  remains 
valid  if  condition  (5.2)  is  replaced  by  (5. 2)'.  Indeed,  if  (5.2)'  holds. 
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then  by  taking  a  to  be  the  empty  set,  we  obtain  p(B  *  |c|)  <  P(G)  <  1. 
This  implies  that  B  -  |c|  is  a  K-matrix.  By  the  same  argument  used  in 
Corollary  3.5  of  [38],  we  may  easily  deduce  that  M  is  an  H-matrix  with 
positive  diagonals. 


Proof  of  Theorem  3*.  Given  k  >  1,  let  a  =  'J  ar^  where 


„  .  k+1  K,  A  .  K+1  „  Ki 

of,  =  li  ;  (x  -  x  ) .  >  0  and  x.  =  E.  .x.  j 

1  i  *  i  li  l 

„  r.  .  k+1  k,  _  ,  k  k-1-, 

a2  lX  :  (x  -  x  )t  <  0  and  =  Eiixi  J  . 


k+1 


Then  the  complement  ofafisB=0^U92  with 


91  - 

£i: 

,  k+1 

!  (X 

-x\^° 

and 

(Bxk+1 

+  q  +  Cxk)i  =0} 

9  2  " 

Us 

.  k+1 
(x 

-xk).<0 

and 

(Bxk 

+  q  +  Cxk  1) ^  =  0]  . 

For  an  index  i  €  ,  we  have 

I  k+1  ki  k+1  k  _  .  k  k-1,  I  k  k-li 

|x  -x^-x.  -x.  <  Ei.(xi-xi  )<EuIx-x  |t  . 

Similarly,  we  may  deduce  that  for  i  6  , 

|,fc+l-xl,|l<Eu  |xk-xk-1|i 

Moreover  for  an  index  i  €  0^  ,  we  have 

I  k+i  ki  k+1  k  -  fr  k  k-1,  ,  -  .k+1  k,  ■>  . 

|x  -x|1-xi  -x.<t[-C(x-x  )].-^Bij(xj  -x^j/B^ 

which  implies 

k+1  ki  ^  i „  i  i  _k  k-1 1  ,  r.  i.  i  i __k+l  _.k| 


B. 


>u  i*  -*  ii  <  ict.i  1*-*|  -  j5i  i“iji 

or  equivalently 

®i.  !xk+1-xk|  <  |cj  !xk-xk'1|  . 


( 12  i) 


(12ii) 


(13) 
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! 


Here  and  denote  respectively,  the  i-th  row  of  the  matrix  B  and 
C.  By  a  similar  argument,  we  may  show  that  (13)  holds  for  i  € 

Hence,  combining  (12)  and  (13),  we  obtain 


1 1 

0  \ 

V+l-*kU 

< 

E 

act 

°  ) 

/  •  k  k-1,  \ 

lx  *  x  !« 

.  V 

®00 

,  ixt+i  -  *ki9  j 

lC0al 

ic0.gi- 

,  k  k-1, 

Ux  ■ x  / 

Since  the  matrix 


0« 


has  a  nonnegative  inverse, 


0  \ 


we  obtain  by  (10) 


k+1  k.  /_ 

x  -  x  <  t  X 

=  i 

0  1 

-1 

1  Eaa 

0  1 

|  |xk-xk-1|  <  G  |xk-xk_1|  . 

User 

®0B  1 

1  tcSaf^ 

^  C00  ^  1 

The  rest  of  the  proof  resembles  that  of  Theorem  3.2  in  [38]  and  is  not 
repeated  here. 
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6.  THE  MONOTONE  APPROACH  FOR  CONVERGENCE 

In  this  section,  we  shall  derive  a  convergence  result  for  the  basic 
algorithm  by  exploiting  a  certain  monotonicity  property  of  the  iterates. 

To  start,  we  state  a  known  result  of  this  kind  and  refer  to  [37]  for  its 
proof. 

Theorem  4.  Let  E  be  a  nonnegative  diagonal  matrix  with  E . ^  <  1  and  let 

(B,  C)  be  a  splitting  of  M  with  B  a  Z-matrix  and  C  nonpositive.  Let  x° 

be  a  feasible  vector  to  the  linear  complementarity  problem  (q,  M) .  For 
k+1 

k  >  0,  let  x  be  the  least  solution  of  the  linear  complementarity  sub¬ 
problem  (1).  Then  the  sequence  [x^]  converges  to  a  solution  of  the  linear 
complementarity  problem  (q,  M) . 

We  should  explain  the  terminology  used  in  the  above  theorem.  First 
of  all,  the  feasible  set  of  the  linear  complementarity  problem  (q,  M)  is 

S=[x:q+Mx>0,x>0}  . 

Vectors  in  S  are  called  feasible  vectors  to  (q,  M) .  It  is  known  [40]  that 
if  M  is  a  Z-matrix  and  if  the  problem  (q,  M)  is  feasible,  i.e.,  if  the  set 
S  is  nonempty,  then  (q,  M)  has  a  least  solution  x*  satisfying  x*  <  x  for 
all  vectors  x  €  S.  Implicit  in  the  statement  of  Theorem  4  is  the  assertion 
that  each  x^+^  exists  if  x°  is  chosen  to  be  feasible. 

An  implication  of  the  assumed  property  of  the  splitting  (B,  C)  in 
Theorem  4  is  that  the  matrix  M  =  B  +  C  must  itself  be  a  Z-matrix.  In  what 
follows,  we  extend  the  theorem  so  that  this  Z-property  of  M  need  not  be 
necessary.  To  provide  the  framework  for  this  extension,  we  review  some 
pertinent  background  results. 
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A  real  square  matrix  B  is  hidden  Z  if  there  exist  Z-matrices  X  and 
Y  such  that  the  following  two  conditions  hold 

(6.1)  BX  =  Y 

X  T 

(6.2)  r  X  +  s  Y  >  0  for  some  vectors  r,  s  >  0  . 

Hidden  Z-matrices  were  introduced  by  Mangasarian  [28,  29]  and  later  studied 
intensively  in  [14,  32,  33,  34,  35],  The  following  are  some  useful 
properties  of  such  matrices.  Their  proofs  can  be  found  in  the  cited  refer¬ 
ences. 

(i)  The  matrix  X  in  (6.1)  is  nonsingular. 

(ii)  There  exist  complementary  index  sets  a  and  0  such  that  the  matrix 

x«  XaB 

\YSa  YSS 

has  a  nonnegative  inverse. 

(iii)  For  every  vector  p  for  which  the  linear  complementarity  problem 
(p,  B)  is  feasiblej  the  problem  (p,  B)  has  a  least  solution  x*,  least 
with  respect  to  the  cone  ordering  induced  by  the  polyhedral  cone  generated 
by  the  matrix  X;  that  is,  x*  is  characterized  by  the  property  that 

X  *  x*  <  X  1  x  (componentwise)  for  every  x  5  S  . 

We  are  now  ready  to  state  the  main  convergence  result  of  this  section. 

Theorem  4 ' .  Let  E  be  a  nonnegative  diagonal  matrix  with  <  1  and  let 
(B,  C)  be  a  splitting  of  the  matrix  M  such  that 

(6.3)  B  is  a  hidden  Z -matrix; 
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(6.4)  There  exists  a  vector  b  such  that  Cx  <  b  for  every  x  feasible  to 
the  problem  (q,  M) ; 

(6.5)  CX  <  0  where  X  is  the  matrix  in  condition  (6.1). 

Let  x°  be  a  feasible  vector  to  the  linear  complementarity  problem  (q,  M) . 
k+1 

For  k  >  0,  let  x  be  the  least  solution  of  the  linear  complementarity 

subproblem  (1),  least  with  respect  to  the  ordering  specified  in  property 

k 

(iii)  above.  Then  the  sequence  [x  }  converges  to  a  solution  of  the  problem 

(q,  M). 


Remark.  Condition  (6.4)  is  satisfied  if  for  instance,  the  matrix  C  is 
a  nonpositive  combination  of  the  rows  of  the  matrix  . 

k+1 

Proof  of  Theorem  4'.  We  show  that  x  exists  and  is  feasible  to  the 

linear  complementarity  problem  (q,  M) .  By  means  of  an  inductive  argument, 

k  k 

we  may  assume  that  this  is  true  for  x  .  Since  x  is  feasible  to  the  problem 

(q>  M) »  it  is  certainly  feasible  to  the  subproblem  (1).  Hence,  according 

k+1 

to  property  (iii)  mentioned  above,  x  exists  and 


-1  k+1  .  -1  k 

X  x  <  X  x 


(14) 


k+1 

To  show  that  x  is  feasible  to  (q,  M),  observe  that 


*k+1  >  Exk  >  0 


and 


q  +  Mx 


k+1 


-1  k+1  k+1  -1  V 

q  +  CX(X  x  /  +  Bx  >  q  +  CX(X  x^  +  Bx 


k+1 


q  +  Cx**  +  Bx1^  >  0 


where  the  first  inequality  follows  from  (14)  and  condition  (6.5),  Con- 


k+1 


1  k. 


sequently,  x  is  feasible  to  (q,  M) .  Now,  the  sequence  <X  x  1  is 


nonincreasing.  We  show  that  it  is  bounded  below  as  well.  Letting 
k  -lk 

w  =  X  x  ,  we  have 

„  k  k  A 
Xw  =  x  >0 

and  by  letting  p  =  q  +  b  , 

Ywk  =  Bxk  >  -(q  +  Cxk_1)  >  -p 

k-1 

where  the  last  inequality  holds  because  each  x  is  feasible  to  the 
problem  (q,  M) ,  By  property  (ii),  it  follows  that 


All 

» 

XQfO 

V 

-1 

! 0  I 

1 

Y0a 

Y00 

rpB  1 

Consequently,  the  sequence  £wk}  and  thus  {xk}  ,  converges.  It  is  obvious 
that  the  limit  of  lx  }  solves  the  linear  complementarity  problem  (q,  M) . 
This  completes  the  proof  of  the  theorem. 


L 
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7.  SOME  CONCLUDING  REMARKS 

In  this  paper,  we  have  described  four  different  approaches  to  establish 
the  convergence  of  a  basic  iterative  method  for  solving  the  linear  complemen¬ 
tarity  problem.  Here,  we  would  like  to  discuss  the  possibility  of  extending 
the  analysis  to  treat  other  complementarity  and  variational  problems. 

Let  f  be  a  mapping  from  Rn  into  itself  and  let  K  be  a  subset  in  Rn. 

The  variational  inequality  problem  (f,  K)  is  to  find  a  vector  x  €  K  such  that 

(y  “  x)T  f(x)  >  0  for  all  y  €  K  . 

It  is  known  [26]  that  if  K  is  a  (convex)  cone,  then  the  above  variational 
problem  is  equivalent  to  the  generalized  complementarity  problem:  find 
x  €  K  such  that 

f(x)  6  K*  and  f(x)Tx  “  0  . 

where  K*  is  the  dual  cone  of  K,  i.e., 

K*  *  {y  €  Rn  :  y^x  >  0  for  all  x  €  K]  . 

Obviously,  the  linear  complementarity  problem  (q,  M)  is  a  special  case  of 
the  generalized  complementarity  problem  with  f(x)  =  q  +  Mx  and  K  being  the 
nonnegative  orthant  of  Rn. 

There  are  at  least  two  families  of  iterative  methods  for  solving  the 

variational  inequality  problem  (f,  K) .  One  of  them  involves  the  idea  of 

function  splitting.  More  precisely,  let  f(x)  *  g(x)  +  b(x)  .  Then  given 
k  k+1 

x  ,  let  x  solve  the  problem: 

(y  -  x)T  (g(x)  +  h(xk))  >0  for  all  x  €  K  .  (15) 

Presumably,  the  function  g  should  possess  certain  desirable  structure  which 
would  allow  this  latter  subproblem  to  be  solved  more  easily  than  the  given 
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problem  (f,  K) .  An  example  of  such  splitting  is  where  g(x)  *  x  and 

h(x)  =  f(x)  -  x.  As  pointed  out  in  [6],  under  this  latter  splitting,  the 

subproblem  (15)  is  equivalent  to  finding  the  projection  of  the  point 
k  k 

x  -  f(x  )  on  the  set  K.  Convergence  of  this  projection  scheme  can  be 
established  (by  a  contraction  argument)  under  some  strong  monotonicity  and 
Lipschitz  continuity  properties  on  f.  See  [2,  6,  18], 

Another  approach  of  iterative  methods  for  solving  the  variational 
inequality  problem  (f,  K)  consists  of  solving  a  sequence  of  subproblems  of 
the  form  :  find  x  €  K  so  that 

(y  -  x)T  fk(x)  >  0  for  all  y  6  K  (16) 

where  f  (x)  is  an  approximation  of  the  given  function  at  the  current  iterate. 

Examples  of  such  methods  include  the  family  of  Quasi-Newton  methods  (which 

include  the  Newton  method)  studied  recently  in  [17,  24,  25]  and  the  PIES- 

k 

type  algorithms  [21,  22,  23].  In  these  examples,  f  (x)  is  either  affine 
or  such  that  the  subproblem  (16)  is  equivalent  to  (and  therefore  can  be  solved 
as)  a  convex  programming  problem. 

As  a  future  research  project,  we  intend  to  develop  a  general  unifying 
framework  for  the  study  of  various  iterative  methods  for  solving  the  vari¬ 
ational  inequality  problem  (f,  K) .  Such  a  study  would  include  the  unification 
and  possible  strengthening  of  known  convergence  results.  That  this  effort 
is  potentially  fruitful  is  strongly  suggested  by  the  work  of  the  present 
paper  and  the  many  special  instances  which  currently  exist  in  the  literature. 
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